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# J. ^ - ^ it n ' «& ^ it * q #j *3 * f*J & m 3N- M #1 «t tt 
&*&#«**l!ttt*kttfl#1fc#-itfc*#*l ' *l 4k Hi ft 

it n it «t n m & #- it ft * # ?>j it # ifit t& • a jl £ ** t& 

ft^-JHttta-at ' rfh it is $t # & m & % A - 



A method and system for utterance verification is disclosed. It can 
extract a sequence of feature vectors from speech signal. At least one 
candidate string is obtained after the process of speech recognition by 
using the sequence of feature vectors. Then, the speech signal is segmented 
into speech segments according to the verification-unit-specified structure 
of candidate string, and that makes each speech segment corresponding to a 
verification-unit. After calculating the sequences of verification-specific 
feature vectors for these speech segments, sequentially use these sequences 
to generate the verification scores of speech segments in verification 
process. This invention uses neural networks for the calculations of 
verification scores. Where each neural network is a Multi-Layer Perceptron 
(MLP) and was developed for each verification-unit. Verification score is 
obtained through using the feed-forward process of MLP. Finally, utterance 
verification score is obtained by combining all of the verification scores of 
speech segments and is used to compare with a pre-defined threshold for 
the decision of acceptance or rejection of the candidate string. 



3 



aft m n & ft ft -ft & % % «. Bfl 



1. 

2. 

3. . 



□ wm 

i. 



2. _ 

3. _ 

4. _ 

5. _ 

6. _ 

7. _ 

8. _ 

9. _ 
10. 



1. 

2. 

3. 



1. 

2. 

3. 



{^tmsEM m^mw. ■ m~um^ = mm ; bm •> mm nmmzi 

1. 

2. 

3. 




* # W % M Ifc - « tsj f£ 3r ^ A % to, > ■*§ - m. A 

% & ^ & m $k i£ & & & & ' & ft 



5 T • 

& » IS) tf^tS (utterance verification)^ #f # ffl ^ 3& t£ 

- a. t§- -i- 4# & i§ tt -i- m m m # *j « *t ^ # jl ^ . 
10 % & mti$L%kt£& ^ « ittai> t& - #j^tn m mi&i% 
-t- m fa % to t ' # & #b & $«i a ^ € «i # -g- ^ % 

15 IS^AS ' ^^Uifflilf (decoding)^ M & &&&&& 
ISt * a XL a tiHSttkfc (hypothesis testing) & #7 f*) f£3&fg 

tf #■ 83 £ 1 SI M ^ f * a # # & * A ffl ^ *3 « «fe ^ 3r 
& H ' «5Fi^>^4Llt-S-'f&St51t««iidi***^ : (word) 
20 r Hij, ' r hj, A r aij ^#J^P^ ° &1fr&&ff&m 

t it # *P if* r Hiji ' @*t*£### 

* ^ ^ *t (acoustic score)521 > tl f M ^ ^ t (language 
25 model score)522 » «&.*[|t&#«*tft#;&!f1fl. (N-Best 
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information)523...# • & • & i& & # H (decoder)53 $f _L 
i£ ^ it & ^ - a t\ % £ r Hi j #) J§fc « ^ *t (verification 
score)54 > & # # * tb & «t ft # it 54& fli tSt ^ H 

5 ffl #'J & 44 %k t& ft ft (Linear Discriminative Analysis, 
LDA) - & H ffi ft ft (decision tree analysis) - & m. # «. *fl ^ 
(neural networks) # ^ it • & f& ' & Ifc Hm # & & til 

» jL#-*t*#.#;flu&,at«tfc » gut • 

#J & $t MtfcmtftZ- ?t (recognition unit) #J % # -fr 4SL 
(speech segment)^ • #J *o $ 1 ffl fff ^ ^ 3(L 3r 

M lb a !§] (subword) ' r hj ^ 

r ai j -I- «. • & ' ^ #J « * ts] r h j JSl r ai j «t « & ^ 
(verification model)62 1 ,623 & -5L ft ^ 
(anti-model)622,624 ' # =fc n r hj A r ai j ft ti M #) U 

W«t«!|^it631#| r aij ^«taj^it632 • i* 
Jfrfcl^ it 631,632j^/£ ^Hij #3*1£^it64 > ji A fli «t 4l 
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-I- :f- * «> 3» * • H *b - S A ffl £ -fr 51 * t » tiff 

5 # is] it «t « # » & if- 4& ^ i$ & * # »r & > it m & 
■kn&mn % & m ft • a±^# + y > a a • 

m a. & a ^ *t ' ^a*-***^*.**** ' 3& & - 4ft -=r 

a ft & _L si ft 4l r l§] if ft tit 2r * A % & j • & « «f £ * 

10 

B. - % W 1*3 & 

. te&*#ifc'*te/;iaiifflj^'#4h4t* + • # & H it if 
is & & w ^ % ~ 3 & fa & & & - mm -m %k t& ir & & % 

& ' *«"^#-J«ttit*7C«*3tjL--flB*#itt««. ' # 

ife^il ' ji «. $ *a if ft it m • 

^ # m 3- ft - § W # £ ft # - « IS) If ft It ^ & a $ 

20 -t- ' aft*3t*fttit^r*^T«Hft • 

«. # # B £ - # & ' ^ m ft dJ 4l tq If ft It # * t ' 

#?']t#-#4ft#-&6*t*#&£t'IB&£ (dimensional) 
# «t A ! * =fc ' ^f^i4#^^it^#/f?'Jlt^i£.-lf-|- 
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ffi UK H t • «#HftAJ.^-«^iq ; ^ ft. . & ft 1* & $ 13 

« # *t 6$ tf * ; ^ £ & J& If # it &} i t # %L ' ^ # it #• tf -g- 
-8-&#Jlfrtt 3- it a iMf - ts] tf ufruft^it ; & & ft ft to it j& 
« ^ it & - ft «t-4L 0L tb *fc ' # *0 tf 4* tt ^tA^FIt 
10 ' ^^jfcfUitig ' &4LJl'J3EJ&ft«i8W • 

* & & # - # $t # it Hi ^ fe - -1ftWlH«lb * - tf * 

s. *> - « it to ; t£ tf -g- *>? #j m & % & m n % « it t§j ^ tq £ 
20 %t # tf -g--t-.gi*.#«t#-*t ft « j. m 

ft*# ; fr$ttf %m&fafe ft 

ttifctf ^*t^#«fe^^#m**-s--s-«^-jifittt^it » a 
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- £ tst ^ n « -a • tt^n^^^tA^t n^t ^ ' & 

£ n « it *S) . & ^ Jty Jg, ^ £ it t*J - 

* ;8fr * # ■« 4* at #f « ' life & # £ * -h *!l « ' A*S#Jt 
it # St ' it 4& & t # *ij o 

E3 > t ^ & 

# M ^ # B £ ^ 1*1 tf «gt tt ^ * A & ft ^ *fc #J ' It 

& Hr^^tf -frte miOit#t§]tf 3&t£ > * t ' € 

J» M,20fe^^-#«t^*t*b^.«3te.21 - "~ tl "a" 1^ M la 

22 * - * # & 33 t *4 * 28 - - ft % £. 'j> - m m & t 

44 * 29 - - » * *J *I * 23 - -Jffctt/8#*.#-*t*L#« *§■ 
24 > - SL M> 4b $- it t 44 * 1 1 * - «t « ^ it ^ # « 26 - - 

* & « 27 * aA-ifetafc^*ttt#«fe25' JU& JM£ 

ft # «L *f 1 2 1 - 122^ 1 23 & it # ^ « ^ *t tf # ° & t ' * 
tf #<] :SLft#*£««&.'lfcJ&-£4** *° (Multi-Layer 
Perceptron ) ° 

ffr-#£M#4B4L>Tit3&B ' * « JW * & 20# 4*. $'J - 
& ^^^T^r^v^Ltf -t-ff ft 101$ • 

2 1 $F tf -I" -ft ft 1 0*/L 4b ( windowing ) jg.ik'® -k & ® &} 
-t- +1 (frame) » « & 3*. £ - & . *t #- *t ft * ?'J 2 1 1 ( # ^ 
S401) ' #*'J ^ it^ff tf -I- #f 1**181 tf ' £ # ?>J 21 1 + • 

#-4m#-*tfc4^k&#&&^teA#4*«.<i. ° 3^tf 
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160.fi (20ms) • -g- 4 # -ft & & 80.fi (10ms) ■ j£ J-X >H * 
f (Hamming Window)^ ^f- }f 4t 4 « ; J. # — -f® # #. ^ & ft 

5 ^ft#&(Mel-ceptral coefficient) - (delta) 
#j # m % $t - #ft^f&(l't-S.^^l ^ 
(delta-log-energy delta-delta-log-energy) ; itb £b ' 4^ itf 
#] £ ffl #J M tf i^j JL fa it ( ceptral mean normalization ) 

* 1$ & & 22 ' a & life tfj JL ^ - £ it l§] 221 (^ ** S402) • l£ 

n&mfkmsa. 22 # ^ffl-a»jR^,.%^rA«^ (Hidden 

Markov Model, HMM)* £.41 ft * * ^ ^ t *t * 28& - # 

* JL ^ - * ^iq * t *r*29*.«-#it^-4#lt#-*t^ * 
15 # ?'J 2 1 1 it Jff 1ft *& # ' a#*JL^— «sS« ° & & ' it * 

If -g- -fej #J « 234fc 4* it *3 221 # 1«) * #T # Jft W «t « 

* 7t ' $p «■ -I- ^ % lo-fo; «>j * ft a & ifit « * it ft n * -g- ft 

23 1,232, 233(3r^S403) • & + ■ £ «g it t*I 22 1 * t X • • H'J feJ 
f-J ft *■ If -g- -I- ft 23 1,232,233* «■ A *I =fc -g- lp tft It * tc 
20 #J =fe -I- Ip -g- ft (subsyllable segment) > 0j *» ** ft it I s ) 22 1 * 
r ♦ j b$ . £ r tj #tq&ft&/ 5 /r^#]&&#lf-t--t-ft 

* «■ a $>j * -g- Ip to « * it r j a r y> j # fM® Ip -t- 
ft ; & i& & m 221 %, % x ^ - «'j *7*iiij*.6*jtf-s--s- ft 

23 1,232,233 % M M M =k l§J to tt &i '-k t*l -g- ft (subword 



n 



segment) • #-J r sky j M it # tit r sky j # n & 1*3 & fii 
f-JiB r sj, > r kj, - A r aij %nJ&M--kift$ki§:%-7t#}'-& 
m -g- «. • 

Hfr-fr-tf-fr-fr «. 23 1 ,232,233 ^ # «. # it fa 
5 #t#tt ##&L24 > ife-ft«t«ffl# 

«.*itfc*/f#ltt£# • * t ' «t«##«t£-*tft*##! 

# & # « # - tt -g- -g- 4k. m n m to m at f - it # je. & 4b $- it 

& + ' *frat#fcttiE.*4b£it^*-to#**&i«J*tt- s P- 
io MUS. A # i£ £ ' ttJL*4b£*t^ft&*t*ft*|*«iH- + #jfc 

*«t&*^*^*A4L«fe«J^ifc6&jE.*^b^ifc.*.#iJE*-S- 
15 *JSt231^4$te£*tfc*#*]ifc#jL*4bifii&4*(^« 
S404) > * t24160#-Jttt«tffl #flt#-*ti^##fc^**«t 

° 1*JS • ^Tfe^I^lil «-S--fr&232A233 
#jftf£ffl$m^it& *^ ?'J 242^243 « 

# ^ ' te#J»lfr3fc*fr«##at£*tto*#?'] 
20 241,242,243$frA:.g.ft*£^&tt #&&25 » J» ^ ft -|- -fr «. 
231,232,233 ftte&Jfo3L#kf8:%-7b&) M # «. 83 & 

121,122,123 it e ** 3* it # tt % ° n m ft t& m 

121,122,123-fift & £ vf ^ *o > ft «^*t 25 1,252, 253 # tf 
ftffl S&121, 122, 123*Hfctt ffl #t#ti^f^?'l 
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241,242,243 ife ft ifr flt (feed-forward) ft ft ft £ # ( # JQl 
S405)° &>fr&fti£J!fc«£#ifc#tt# ' «Tf JUHtl 
«#A«*M21tf£4fctt^*t2514L5&«*t*;&**&ifc- 

If - # M * 5 ffi «fe #J A # & 1 2 1 4^ tt: S 

«A-«rSl*33 ' JL - «t IS # it 4& «■ M JL - & # '«. «9 
51-° £ t ' ^^>#314^^#M70 (input neuron)3 1 1 ffl J-X -fk 

#itft*#>#«tiiDi • &i&4L$fribJ-fi§#&;i32' it HJi32 

^ fil ft # 7b (hidden neuron)321ffl «#^^A>|31t^ 
#tt*fr^##it6&*fri& ' JLW#**friU.£.*&i&*33' ^itJ 
£ 33# ffl - #T A # «fc to (output neuron) 33 1 & & & fit ft 
*32&flr##i ft ft • 3£$fr iB i&%kWtft # «. 

*tfc*#J!fct£&*. - EUt ' ij.i&.tifettl&ltft'rt ' 
A «t tt ffl # «. *t ft * # ?<] 24 1« #• 4$ ft * «t IS * ° JHt 
*^*t251*pA^3£#fc«#*#-^Mf'ttfl&4f-i'J ° 

J.^«#^^s&-l21t4-^#M7G^^iB ' f& T *fr /v 

# m. to #j ft A ( ft ft # » to a ft dJ # «. to ) R'j * ffl t 

W * * tf # : 

l 

ow/. = 

y 1 + exp(-£ w n outi +b.) 

* t ' 0M ';& * M ( H ft * * *fr til * ) t » # «. to 

&i^ilf ' ^ ^ - >f (^Ayf £ft ft* ) t £ 
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fc&itftdilt » w fi %> M - A % # » to J. >t ^ y #1 # & jt 

60 # t (weight) ' b J$t,^^ % y'^ # MtL 60 4& #4 (bias) • 
£ &j&J!fr«^*fc251, 252,2536$ tf # ft. • ' i£ i& 3& 

«#&^#4**l.263Mt£ A it > a 

# «■ it l^j 221 ^ f§] If Jffc tt ^ & 26 1 (# ^ 406) • & ft * 3R. & fe 
27ft ffl - fl *t H # ft (threshold) A 1*1 ft 4fit tt ^ *t 26 1 it 
ft fcb&(# Jf$407) ' 4ts0*f«fc«#*t261*.**'r1*fti$ • f; 

m $ & 20& € jfc m m.m22\(-$? m S408) • & ^ m & *b «n 

S409) • 

fl& * r ft. * * *fc m ft ffl £ ># A *° # n * ft ffl 

3o ait j& ffl # «L # it ft 4 # ?'J * 3- #t >i 60 if 4 -I- ft * ^ 

$ft>!fc60J!fctt-¥-7b ' ffl * & 1® 3fc «£ * Tt, ^ £ Jf & 60 

A m m mm 7t 60 if 4 * « » «t^l^^fe^f f i'J^ 

M 6$ J: * ' it ffi> ^ o t»| -t ' eSfr0|*,*3t*«t*ffl 

# m. $~ it 6 4 # m 4 ^ « -I- 4 ft «t & 4a ft A 60 a # ft - 

ft. ' #iti&^t£lE7# (error back-propagation)# f >f # * 

^ ^ #L « J: (mean square error)*. US 4££-t4fc*»4£ttflt4 
f o ^ # 4 - #J *» > t\\$L-~m%k1&%-7l%, f )(j 60 £ A & *° 

60 If -I- 4 ft * & ft & $>] * « JL 7b r x j 60 If 4 4 ft 0 «r 

^MM^mm^Tt^ r x j 60 it 44ft ' & a #ft & i ' & 
*.»*a«ft£o-«ii^|fcttttJ£&ftfflii£tt*l*2r* 
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&&Mtfr >^mtfL& £ M &frtf$m & &&&&&&& 

ffl ^ °& -8- *f * ' _t i£ tii| * £ * A *e m ffl #J *l * * # * 
£ $J ■# -t- -f- * J- * It * IS) tfl. tb (Signal Noise Ration, 
SNR)#J -fr-ft ' *i -ft ffl £ # f*3 ^-^(In-Car noise^flfc 
A*tR.'* bb ^9dB - 3dB * OdB - -3dB * j&-9dB#j * -8" -ft ' 

is ' a *j£ frugal > #j&#J^#* iB £^']'<&-g-- : ^ : - 
> # W a -A * Ip & -k ntt 
H*it6«Hfc-8-**fftl&*fc-t ' J. f - Tbtf * 3t A - -fB 

ft & ft M ft & ft & & ^ §: % W M & ft M M #j %kn Sf- 
' ®*b&4#*£t&-t-#m & #, £ •* -8" 4t * 
,^i.^Pi ' # & * «t @ # - flii^t ' £ £ 

w ' >n # ^ # *•] # # ' jb tf f ti#I B ^$ • -f b a& & 
* #1 - # £ A *t * • * & * « - ' -t * t* £ 
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x. - m * ffi * «. H ^ 

* i n « « *° *. « * # * * * * tf * * ^ * * * 4 

« 2 © % % «. « * *. * * * ^ * * * * * * * * ^ 
% 3ffl A *# a ^ t **l « * ° 

^4ia^^#B^***'j^^^^^^^^ al ° 



^ > SI M,t£ B £ 

*#*««H21, 122,123 ft *20 

15 ******** 2 1 #*******I211 

* * ««« ^22 * *« 221 » * « « *23 

# A * Jttt * * #J * * * * 23 1 ,232,233 
fetitffl #at**tft#***24 

jfcttffl #*t**fi *#*J 241,242,243 
20 Jttc«^«t*t**fe25 

it *-t-4St*-«t*^it 251,252,253 
**fr*****26 tt*****261 
ftft«»27 *****#*28 
«**«*29 Jft^*31 



f& ^ # «• 3 1 1 
« 7b 331 

it -r *^ ^ it 522 

ii 53 
tf -I- it ft 6 1 
& ft « 622,624 

64 



fil&Jt 32 
«T * * 33 
t& * ft 5 1 
**^*L521 

mmmnm^ f tn.523 

J§&t£^*l54 
«t*« 34 621,623 
*fc«^*t 63 1,632 



i . - m. n it %k is ?t & > & ^ t n ip- m- • 

n ; 

5 (B) $&m&r&^$tfa : t^n^^s--m^mnn t « 
ji ^ 1$ * ^ - m it t §] ; 

(c) & as & ittsj^ts) * & &mmM &3%kt%$- 7t&-m$k 

(D) 1£ #l# -t--t-^m#m^^1S^- 7t^JE-*Mb#- 

*t ^ it « 4i m. #- ft * n ; 

(E) 4£ l£ ^ l£-g- -g-&#r#l *|-i&*.«r1£ Jp- it #j ## & 

# £ t£ -g--f--&^3&i£ ; 
15 (F) ^##r#lf-f--g--&^^l£^it > a%L&-mn$k 

(G) $p i£ t§] it s& m & & & - m t9i z„ n ^ & tb & ' # n 
mn$ki% a ifr ' & ^ -m m m. n • & ^ m & 

t ' m%k1§:%- X>Z. JL&Jb % - &i#m#*t fa * 

ttjfe&m^ M. ' tf ti| If # t «" H $'J l£ JSfe l£ ^F- 

7t #J l# -I- & # #t # & ft t # *n # $'J 0 
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t ' #■ - «k « it # «f M $- - 0 # « « • JL tfc & # & Jg 
s& # — £ M " 

4.*» f if *.#J II SI 9 ♦ 1 ♦ t* # * A 

its 4LJSfct£ - a # it ft # ^ jrfcm M. » #.*i*m* £ # 

nft&z-tktstm &&&&& n &n *t* £ * & • 
* t ' & m & g m m m t& %kt& ft > a>j a 

7.** t tf ft S 3* m it^^r * > *+ ' #^(F) 

m % n it * «. ^ * « ^ .*t # -fit h t* «§- ifit- « ^ 

-I- it fa - % °% -g- -f- & 4l If -I- if ft ° 
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9. *» t * -I- #0 la SI # 6^ #r 54 ^ 2r ^ • t • f£ #• % *>l 

10. - # tsj ft HkW: % to > : 

- # «L # M. & m to. • ffl « * - ft A. I § -fr -ft ft t # 

5. # - « it t§) ; 

- is -g- $J & Sa > ft&jft&i&tq ft 3£rtr*J- &#j*kl& 

io - Kk « « # «t # it $L # & te ' ft * & tt * tf * * m 

ft ?>J ite it* 4b ' ia£ £tftttfli ##t£&fc ; 

20 & ^ *'J IE Jg, t£ 4£ it t§] • 

11. t n # *j i£ s * ioji m ^ ^ % to » & 1 » t£ a 
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&n & f m m & n ^ k & n % ^ & #] & m. $- $t ft ± 
n m # n • 

12. -k° t tfr -iM'JIe,® $ 10^mi4^^ *fc ' * t ' #- 

^ « f - it #. ^ a. 5. - # & ^ sg- > 3- mm # AS. ^ #> & - 

5 £ >f ^. £° 0 

13. *o t «-**'J3e, n $ n^^m. % *t » * * ' £ 

&WL^$t & i ft & 
%t . a - it n # a 45. aj # *»j t #■ - «6t « n & m. # *t ^ 

10 ^^^^*t • 

14. *> t tf.iM>j|& is * 12& & ' * t ' * £ 

£ ^ £o o 

15 i5. *i t m- * *>j & m % 14^ at it ^ & *, ' tii «n # m fj 
*o . ^ t ' tni«nm^ffl # re** ' 

20 *J i # tt. * 1 » & ' I'J I/O' 

16. *» t ifr -Mi ft ffl # 10# /tf ifc ]fc *fc ' * t ' t$ 4* 
it & ^ # 4& & # m # ft -g- -g- « 4l J«t f£ ^ tk ft ¥ Hi #. % 
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18. *» t tf-tM'JIe.® £ 15* *t ' * + ' 

5 



S401 



S402 



.S403 



t'J ^ i J >&;&JSfrt£ * 7t # & 



.S409 
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y S405 
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